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Two central concepts in probability theory are those 
of independence and mutually exclusive events. This document is 
intended to provide suggestions to teachers that can be used to equip 
students with an intuitive, comprehensive understanding of these 
basic concepts in probability. The first section of the paper 
delineates mutually exclusive and non-mutually exclusive events. The 
distinction between contradictions and contraries is explained and 
example o using dice are described which can be used by teachers to 
help students understand their differences. The second section deals 
with independent versus dependent events. Some common 
misunderstandings are presented which relate to these terms, and 
sample teaching activities are suggested. The final section deals 
with the confusion some students have when attempting to 
differentiate between independent events and exclusive events. 
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I ntroducing Disjoint and Independent 
Even ts in Probability 

Two central concepts in probability theory are those of ^ independence' and 

of 'mutually exclusive' events* In this article we provide for the instructor 

suggestions that can be used to ©quip students with an intuitive, comprehensive 

understanding of these basic concepts. Let us examine each of these concepts 

in turn along with common student misunderstandings. 

1* Mutually-Exclusive vs Non Mutually Exclusive Events 

Outcomes are mutually-exclusive when the occurrence of one of them rules 

out the possibility of the occurrence of the other events of concern. The 

outcomes, for example, on the toss of a single die are 1, 2, 3, 4, 5 or 6, 

These outcomes are all mutually exclusive since when a die is tossed and a 

number turns up, all the other numbers cannot occur. On the other hand, the 

events "eating rocky mountain oysters for breakfast" and "eating vegetable soup 

for breakfast M are not mutually exclusive since it is possible that one has 

both for breakfast, however improbable that might be, 

The distinction between contradiction and contrariety should be introduced 

at this point to students. Two statements are contradictories when they cannot 

both be true, and cannot both be false, Two statements are contraries if they 

can both be false and a third statement , different from both, can be true. For 

example, "It is raining outside this building at this moment" and "It is not 

raining outside this building at this moment* 4 are contradictories. However, 

the statements "All mathematicians are very intelligent 11 and "No mathematicians 

are very intelligent" are contraries since although bath cannot be true, it is 

almost certainly the case that both are false. Some mathematicians are very 

intelligent and others are not. 
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There art mutually exclusive events of both types. In the die tossing 
example already described we could divide the simple space into two parts, say, 
■even" and "odd". These events are mutually exclusive and contradictory. 
Contradictories are a specific case of mutually exclusive events, that is, 
contradictories are compliment an* events. Notice that by taking t =he sample 
space (a list of all the mutually - elusive outcomes) to be the oute*=omes 1, 2, 
3, 4, 5 and 6 we have implicitly made an assumption about the operat. ion of die 
tossing: namely, that it is impossible for the die to come to rest m on a point 
or an edge, If the sample space were expanded to include these possibilities 
then the events "even" and "odd" are contraries. The reason for U» troducing 
thse concepts to students is, of course, to ensure that the student is quite 
clear about the fact that a pair of mutually exclusive events ara-e not 
necessarily complementary events. 

The die example presented about has somewhat of a contrived air about it 
because most of us would accept the proposition that the probability^ of a die 
coming to rest on a point or an edge is zero. However , things are nnot always 
that clear cut in nature. Amongst humans there ire males, females, and other 
borderline cases (e.g., Klinefelter 's syndrom) which occur with n-.onzero 
probability. Thus, the events "male" and 'female' are in fact eontra-.ries. 

Another point that should be considered In class is the fact thiiat very 
often in the real world it is not always clear whether or not two evaents are 
mutually exclusive. The examples we present to students when teaehtang the 
concept are, understandably, eleareut. For exanple, if we obtain a Mix on a 
single toss of a fair die, it rules out the possibility of obtaining a one, 
two, three, four, or five. In the real world we often do not haw* enough 
information to be sure. Not all students are iware that "Clark Kennf and 
"iuperman" are not, mutually exclusive. It would be useful to draw esxamples 
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frc ife Wl -« 1 distinction betwf&en eontr adietor y , contrary, and between 
•muv.aiv exc usiv, and non-?otually ^exclusive are not always clear. The 

pL 1 0t n S to ensure that studwnti don't think that there is always a 

-r 4 -t or .ar cut answer, 

2. in - ?ndmt MS Dependent Euonts 

Events are independent when the occurrence (or nonoccurrence) of one of the 
events carries no information about thee occurrence (or nonoccurrence) of the 
other event. Mathematically, two wvents A and B are considered to be 
independent if P(An B) * PCAlx PCB). For example, if the probability that 
Obadiah has eseargot for breakftst tomor row is 0.4 and the probability that it 
ujill rain tomorrow is 0.3, then the pr- obability that both, events will occur 
tomorrow is (0.4) x (0.3) =0,12. Wh-.en we have more than two events, the 
situation becomes a bit more compile** ted—all possible combinations of 
component events must follow the mull ti plication rule. That is, each 
combination must also involve independent t events. 

Students have several difficulties wfiith the distinction between independent 
mnd dependent events. The first parallels the problem that arises with 
mutually exclusive events, namely, deter—mining when events in the real world 
aire independent or dependent. Once agaifta, we seldom help students to bridge 
tt-tm gap between the fuzzy distinctions ^apparent in nature and the very rigid 
distinctions made in mathematics, If we toss a pair of dice, the outcome that 
occurs on one die obviously (for most of - us) does not influence what outcome 
will occur on the other die, in other • cases one often needs expertise in a 
particular area to make a reasoned judgement whether particular events are 
independent or not. Many years of reseiTTch were required to demonstrate, for 
example, that there is a dependent rels-stienship between smoking and lung 
di -sease (see also, Ayton & Wright, 1988), 



ERIC 



5 



Basic Concepts in Probability 

4 

A second common misunderstanding involves interpreting a dependent 
relationship between events as a causal relationship. There are, of course, 
situations where this is plausible, for example, having tuberculosis is both 
causally and statistically dependent on having tuberculosis bacilli in one's 
body. However, there are many examples of dependent relationships between 
events where no causal relationship is involved. For example, in some locales 
the number of storks and the birthrate are known to be positively correlated 
(Hofstatter Wendt, 1567), Thus in such locales the sighting of a stork and 
the occurrence of a birth are statistically dependent events. However, they 
are obviously not causally dependent. There is also a dependent relationship 
between the meltfng of tar and the occurrence of sunstroke. Again, these 
events are not causally dependent, but in this example, they are linked to a 
common causal factor which is the intensity of the sunshine reaching the 
ground. The use of examples such as these will help students to understand the 
distinctions between statistical and causal dependence! distinctions which we 
all too often neglect to make in the classroom. 

An issue that sometimes arises with students who have done reading in 
physics or philosophy concerns whether events can ever really be independent. 
For example, some writers (e.g., Capra, 1975) take a holistic approach to the 
universe in which the universe is considered to be a web of relationships where 
all things communicate intimately with one another and all being is shared. 
Statisticians sometimes suggest similar things, adding to student confusion. 
Hays (1981, p. 293), for example, tells us that 'There is surely nothing on 
earth that is completely independent of anything else' , A student coming 
across such a statement would be understandably confused. The student might 
reason that if nothing is completely independent of anything else, then how can 
we apply , jbability formulas that assume independence of events? The answer 
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is that application of such formulas doesn't need to assume that the events are 
completely independent of each other, only that any relationship is negligible. 
For example, every body in the universe has some interactive fravi tational 
attraction with every other body, but th© gravitational attraction between a 
human being and a star light years away is so minute that it can be considered 
non-existent. Underwood (1957, p. 6) put it welli 

"The length of an astronomer's toenails isn't related to 
phases of the moon; the color of the secretary's hair isn't 
related to the height to which the. corn grows in an Iowa 
field, and a pygmy tribe in New Guinea has little influence 
on the alcoholic consumption of a truck drive in Brooklyn. • 

Finally, the very way we express ourselves in iangutge may create 

difficulties in understanding independence. We use phrases such as "events A 

and B are independent if knowledge about whether A has occurred provides us 

with no knowledge about whether B has occurred", in a very subtle way an 

element of time is hinted at in such a statement and it often confuses 

students. It is therefore important to emphasiie to students that whatever the 

temporal relationship between two (or more) independent events, a knowledge of 

the occurrence (or nonoccurrence) of any of the events provides one with no 

knowledge of the future or past outcomes of any of the other events, 

In order to understand how this problem with time can arise we will 

consider the simple example of a coin tossing experiment in which a fair coin 

is tossed six times. Associated with the experiment is a sample space, the 

list of all possible outcomes of that experiment, and a collection of events. 

The latter represent more general descriptions of outcomes of the experiment 

and can usually occur in more than oneway. For example, the event 'three 

heads come up in the six tosses of a coin' can occur i n an W8ys . Now suppose 

that you are blindfolded before the experiment is conducted and that you have 

the opportunity to bet that the last two tosses of the coin will come up heads, 
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Quick mental arithmetic tells you that this can happen one time in four. Now 
the coin is tossed six times and, still blindfolded, you are told that the 
outcome was three heads out of six tosses and given an opportunity to revist 
your bet. You realise that there are only four ways in which the outcome of 
six tosses of a coin can result in a total of three heads with a head on each 
of the last two tosses. Therefore, the relative chances of being a winner once 
you've been given some knowledge of the outcome of the experiment has been 
reduced from one-in-four to one-in-five. The events 'three heads in six tosses 
of a coin' and 'the last two tosses in a sequence of six tosses are heads' are 
not independent. 

The element of time in the above example relates not to the way in which 
the experiment was conducted, but to the way in which we think. We were given 
some knowledge about the outcome of the experiment, namely that three heads had 
occurred. This in turn gives us some knowledge about the likelihood of other 
events that may have occurred. We now think that it is less likely that there 
was a head on each of the last two tosses than before the experiment was 
conducted. This is essentially what we mean when we say that two events are 
dependent, knowledge that one event has occurred conveys information about 
whether or not the second event also occurred. On the other, hand the events 
'heads on the first toss' and 'heads on the third toss' are independent, 
because when we re-evaluate the likelihood that second event occurred in light 
of the occurrence of the first event, we see that we have no more knowledge 
about the outcome of the second event. 

The element of time which we mentioned is associated with this process of 
reevaluation of probabilities after some information about the outcome of the 
experiment is available. These a posteriori , or conditional probabilities can 
only be applied to decision making, such as whether to continue a bet or raise 
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the ante in a poker game, after some information about the outcome of t i he 
experiment is available. These probabilities are evaluated byconeeptua. lly 
repeating the experiment with a restricted sample space. We feel (hit students 
have some inkling of what goes on, but that we don't usually explain these 
concepts to them carefully enough. We suspect that they do feel that something 
happens as time goes on but don't really understand its mechanics, We should 
point out, using simple examples such as coin tossing or card g«, that we 
construct new probability models for the experiment as it progress!} (or af— ter 
the fact) which are conditional upon information which we have received atoout 
the outcome of the experiment to that point. With these ideas about 
conditional probability in place it can then be shown that two events, say- A 
and B, are independent if the a'priori probability of A is equal to the m* 
posteriori probability of A given B, Mathematically, these ideas in sxprt- ssed 
as follows: 

1) P(A/B) * P(AHB) / P(B) 

This describes the relative chance that event A will occur within event B. 

2) If A and B are independent then we will have 

PCA/B) - P(AnB) / P(B> - P(A) so that P(AnB) - P(A) x P(B), which is thie 
usual expression used to test for the independence of events. This could toe 
followed by pointing out that, if A,B are independent, then P(AnB)^(A)x F=-(B) 
and if A,B are mutually exclusive, then P(AnB)=P(4>=0. We think that such *an 
approach is much easier for the student to understand than the standard 
approach which is found in most text books, especially those in (fti social 
sciences. The latter consists of stating the usual definition of kdependen t, 
i.e. that A and B are independent if 

P(ADB) = P(A) x P(B), 
and then presenting a few examples to illustrate the truth of the afinitioi 
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We oft e n CMfuse- the student through our use of language- , as discussed above 
and the failure c o link the ideas of independence and c 0 n <Htional probability. 
3. fifl-Qf^m Between Independent Events and Mutually Ex clusive Events 

Student! not only have difficulty with the notions o^f mutually exclusive 
and ihdeptnftnt r- uents, they very often confuse the two. The confusion between 
independents mutually exclusive events seems to be universal and robust. It 
comes up yhothew we use the expression "Mutually exclusive' or "disjoint 
eventaS Either we apply set theoretical terms or not. and whether we draw 
diagrams or net. Sometimes the fallacy appears to be eusn stronger when one 
draws a VenNiagi— am of disjoint events (figure 1), 

Figure 1 



Students often say i "Well, these two events have nothing je^ common, nothing to 
do with *0fch other they don't touch... so they ire inde pendent . ■ Often our 

language i h troduet-sE this misconception in a very eeipiUing way. 

We frequeitly answer the question "If A and B are mutually exclusive, does 
it follow that mhey are not independent?" with the repl^ , "well, no. For 
example, . , anc=j then trot out the pathological eisnple of a pair of events 
of probability aesro without further explanation, However, in certain 
pathological casts, the concept of mutually exeiusiue ev .nts it the exact 
antithesis of the- concept of independent events. Mutual! y exclusive events 
provide an mpL m of ar extreme case of (negative) dep-endence. A nice 
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illustration is provided by Hays (1911, pp , 43-44). Suppose that all men are 
either 'bald' or have a "full head of hair". These are mutually exclusive. 
Let us say the probability of selecting a bald man from the population is 0.60; 
the probability of selecting a hairy man would be 0.40. If these two events 
were independent, then the probability of selecting a man who is both bald with 
a head full of hair would be equal to (0.60) x (0.40). But the probability of 
such a joint event is, of course, zero. Mutually exclusive events of non-zero 
probabilities are never independent. Ad hoc explanations tend to deal with 
specific abberations that may lead to further confusions and moreover avoid 
dealing with the fundamental principles upon which the student's question is 
based. 

By planning for instruction of these two fundamental concepts we can insure 
that the student's understanding is built up systematically. This provides a 
firmer foundation upon which the student can acquire a grasp of probability 
theory . 
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